Predictive validity of the Individual Placement and Support fidelity scale (IPS-25): A replication study

BACKGROUND: Fidelity scales are used to monitor adherence to evidence-based practices. The underlying assumption is that high fidelity predicts better outcomes. The IPS-25 is a fidelity scale measuring adherence to the Individual Placement and Support (IPS) model. A previous study found a significant association between the IPS-25 and competitive employment outcome. The current study sought to replicate this finding. OBJECTIVE: We hypothesized that fidelity, as measured by the IPS-25, would predict program-level competitive employment rate. METHODS: Fidelity was assessed by the IPS-25 fidelity scale in 79 IPS programs in 12 states. The quarterly competitive employment rate was collected as part of quality improvement efforts in the IPS Learning Community. We examined the correlation between these two measures. RESULTS: Five components of the IPS-25 including vocational generalists, caseload size and rapid job search were successfully implemented in most IPS programs, whereas nine fidelity components, including time-unlimited supports and agency leadership support, were less widely implemented. As hypothesized, the IPS-25 total score was significantly associated with competitive employment rate (r= 0.27, p= 0.02). CONCLUSIONS: The study demonstrated that IPS programs adhering to good fidelity are more likely to achieve enhanced competitive employment outcomes than the sites that have low fidelity.